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p> || Abstract 

^^ , The Fourier Entropy-Influence (FEI) conjecture of Friedgut and Kalai [FK96] seeks to relate 

■^ ' two fundamental measures of Boolean function complexity: it states that H[/] < C ■ Inf [/] 

holds for every Boolean function /, where H[/] denotes the spectral entropy of /, Inf [/] is its 
r ) ' total influence, and C > is a universal constant. Despite significant interest in the conjecture 



en 



X 



it has only been shown to hold for a few classes of Boolean functions 



f/2 ■ Our main result is a composition theorem for the FEI conjecture. We show that ii gi, . . . ,gk 

O I are functions over disjoint sets of variables satisfying the conjecture, and if the Fourier trans- 

form of F taken with respect to the product distribution with biases E[gi], . . . , E,[gk] satisfies 
the conjecture, then their composition F{gi{x^), . . . ,gk[x^)) satisfies the conjecture. As an ap- 
K^ . plication we show that the FEI conjecture holds for read-once formulas over arbitrary gates of 

r^ I bounded arity, extending a recent result [OWZll] which proved it for read-once decision trees. 

Our techniques also yield an explicit function with the largest known ratio of C > 6.278 between 
H[/] and Inf [/], improving on the previous lower bound of 4.615. 



^ ! 1 Introduction 



A longstanding and important open problem in the field of Analysis of Boolean Functions is the 
Fourier Entropy-Influence conjecture made by Ehud Friedgut and Gil Kalai in 1996 [FK96, Kal07]. 
The conjecture seeks to relate two fundamental analytic measures of Boolean function complexity, 
C^ . the spectral entropy and total influence: 

Fourier Entropy- Influence (FEI) Conjecture. There exists a universal constant C > such 
that for every Boolean function f : { — 1, 1}" — > { — 1, 1}, it holds that H[/] < C ■ Inf[/]. That is, 

SC[n] \JW) / sc[n] 

Applying Parseval's identity to a Boolean function / we get '^sc\n]fi^)^ ~ ^[/(*)^] = 1' 
and so the Fourier coefficients of / induce a probability distribution §f over the 2" subsets of [n] 
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wherein S C [n] has "weight" (probabihty mass) /{S)"^. The spectral entropy of /, denoted H[/], 
is the Shannon entropy of S/, quantifying how spread out the Fourier weight of / is across all 2" 
monomials. The influence of a coordinate i € [n] on / is Infj[/] = Pr[f(x) ^ f{x®^)Y, where x®* 
denotes x with its i-th. bit flipped, and the total influence of / is simply Inf[/] = XlILi Iiifi[/]- 
Straightforward Fourier-analytic calculations show that this combinatorial definition is equivalent to 
the quantity Es^Sy [|S|] = Xlscfnl l*^! '/('S')^; and so total influence measures the degree distribution 
of the monomials of /, weighted by the squared- magnitude of its coefficients. Roughly speaking 
then, the FEI conjecture states that a Boolean function whose Fourier weight is well "spread out" 
(i.e. has high spectral entropy) must have a significant portion of its Fourier weight lying on high 
degree monomials (i.e. have high total influence).^ 

In addition to being a natural question concerning the Fourier spectrum of Boolean functions, 
the FEI conjecture also has important connections to several areas of theoretical computer science 
and mathematics. Friedgut and Kalai's original motivation was to understand general conditions 
under which monotone graph properties exhibit sharp thresholds, and the FEI conjecture captures 
the intuition that having significant symmetry, hence high spectral entropy, is one such condition. 
Besides its applications in the study of random graphs, the FEI conjecture is known to imply the 
celebrated Kahn-Kalai-Linial theorem [KKL88]: 

KKL Theorem. For every Boolean function f there exists an i & [n] such that Infj[/] = Var[/] • 

The FEI conjecture also implies Mansour's conjecture [Man94]: 

Mansour's Conjecture. Let f be a Boolean function computed by a t-terni DNF formula. For any 
constant e > there exists a collection S C 2^"^ of cardinality poly(t) such that X^gg^ fiS)"^ > 1 — £• 

Combined with recent work of Gopalan et al. [GKKOSa], Mansour's conjecture yields an efficient 
algorithm for agnostically learning the class of poly(n)-term DNF formulas from queries. This would 
resolve a central open problem in computational learning theory [GKKOSb]. De et al. also noted that 
sufficiently strong versions of Mansour's conjecture would yield improved pseudorandom generators 
for depth-2 AC circuits [DETTIO]. More generally, the FEI conjecture implies the existence of 
sparse L2-approximators for Boolean functions with small total infiuence: 

Sparse L2-approximators. Assume the FEI conjecture holds. Then for every Boolean function 
/ there exists a 2*^ (^"^l'^^' ^■'-sparse polynomial p : IR" —)■ R such that E[(/(a;) — p{x))'^] < e. 

By Friedgut's junta theorem [Fri98], the above holds unconditionally with a weaker bound of 
20(lnf[/] /£ )^ This is the main technical ingredient underlying several of the best known uniform- 
distribution learning algorithms [Ser04, OS08]. 

For more on the FEI conjecture we refer the reader to Kalai's blog post [Kal07]. 

1.1 Our results 

Our research is motivated by the following question: 

Question 1. Let F : {—1,1}'^ — )• {—1,1} and gi, . . . ,gk : {—1,1}^ -^ { — 1,1}. What properties 
do F and gi, . . . ,gk have to satisfy for the FEI conjecture to hold for the disjoint composition 
f{x\...,x^)=F{gi{x^),...,gk{x^))? 



^AU probabilities and expectations are with respect to the uniform distribution unless otherwise stated. 

■^The assumption that / is Boolean-valued is crucial here, as the same conjecture is false for functions / : 
{ — 1,1}" — >■ IR satisfying X^scinl /("S")^ = 1- Th^ canonical counterexample is f{x) = -y^Yl^^i^i which has to- 
tal influence 1 and spectral entropy logj n. 



Despite its simplicity this question has not been weh understood. For example, prior to our work 
the FEI conjecture was open even for read-once DNFs (such as the "tribes" function); these are 
the disjoint compositions of -F = OR and gi, ■ ■ ■ ,gk = AND, perhaps two of the most basic Boolean 
functions with extremely simple Fourier spectra. Indeed, Mansour's conjecture, a weaker conjecture 
than FEI, was only recently shown to hold for read-once DNFs [KLWIO, DETTIO]. Besides being 
a fundamental question concerning the behavior of spectral entropy and total influence under 
composition. Question 1 (and our answer to it) also has implications for a natural approach towards 
disproving the FEI conjecture; we elaborate on this at the end of this section. 

A particularly appealing and general answer to Question 1 that one may hope for would be the 
following: "if H[F] < Ci ■ Inf [F] and U[gi] < C2 ■ Inf[gi] for all i G [k], then H[/] < maxjCi, C2} • 
Inf[/]." While this is easily seen to be false'\ our main result shows that this proposed answer 
to Question 1 is in fact true for a carefully chosen sharpening of the FEI conjecture. To arrive at 
a formulation that bootstraps itself, we first consider a slight strengthening of the FEI conjecture 
which we call FEI+ , and then work with a generalization of FEI+ that concerns the Fourier spectrum 
of / not just with respect to the uniform distribution, but an arbitrary product distribution over 
{-1,1}": 

Conjecture 1 (FEI+ for product distributions). There is a universal constant C > such that the 
following holds. Let fi = {fii, . . . , fi^) be any sequence of biases and f : {—1, 1}" — > {—1, 1}. Here 
the notation { — 1, 1}!] means that we think of { — 1, 1}" as being endowed with the ^-biased product 

probability distribution in which E^[xj] = //j for all i ^[n]. Let {f {S)} s<z[n] be the ^-biased Fourier 
coefficients of f . Then 

<C-(InP[/]-Var[/]). 
2i„„ /rr n _ ,,2w7,'c\2 




We write H'^[/] to denote the quantity Xlscfnl fi^) 1°S ( HieS^^ ~ k)/ f{S) j , and so the inequal- 
ity of Conjecture 1 can be equivalently stated as H^[/--'^] < C ■ (Inf'*[/] — Var^[/]). 

In Proposition 2.1 we show that Conjecture 1 with /i = (0, ... ,0) (the uniform distribution) 
implies the FEI conjecture. We say that a Boolean function / "satisfies /.t-biased FEI"*" with factor 
C" if the /i-biased Fourier transform of / satisfies the inequality of Conjecture 1. Our main result, 
which we prove in Section 3, is a composition theorem for FEI"'': 

Theorem 1. Let f{x^,...,x ) = F{gi{x^), . . . ,gk{x )), where the domain of f is endowed with 
a product distribution jjl. Suppose gi,. . . ,gi^ satisfy ^-biased FEI'^ with factor Ci and F satisfies 
rj-biased FEF' with factor C2, where rj = {E^[gi], . . . , E^[gk]). Then f satisfies fi-biased FEF' with 
factor maxjCi, C2}. 

Theorem 1 suggests an inductive approach towards proving the FEI conjecture for read-once de 
Morgan formulas: since the dictators itxj trivially satisfy uniform-distribution FEI+ with factor 1, 
it suffices to prove that both AND2 and OR2 satisfy /i-biased FEI"*" with some constant independent 
of fj. ^ [—1, 1]^. In Section 4 we prove that in fact every F : {—1, l}'^ — > {—1, 1} satisfies ;U-biased 
FEI"*" with a factor depending only on its arity k and not the biases jii, . . . , fik- 

Theorem 2. Every F : { — 1, l}'^ —^ { — 1, 1} satisfies fi-biased FEL^ with factor C = 2^^''^ for any 
product distribution fj, = (/zi, . . . , fj,k)- 



For example, by considering F = OR2, the 2-bit disjunction, and gi,g2 = AND2, the 2-bit conjunction. 



Together, Theorems 1 and 2 imply: 

Theorem 3. Let f be computed by a read- once formula over the basis B and ^ be any sequences 
of biases. Then f satisfies fi-biased FET^ with factor C, where C depends only on the arity of the 
gates in B. 

Since uniform-distribution FEI"'" is a strengthening of the FEI conjecture, Theorem 3 imphes 
that the FEI conjecture holds for read-once formulas over arbitrary gates of bounded arity. As 
mentioned above, prior to our work the FEI conjecture was open even for the class of read-once 
DNFs, a small subclass of read-once formulas over the de Morgan basis {AND2, OR2, NOT} of arity 
2. Read-once formulas over a rich basis B are a natural generalization of read-once de Morgan 
formulas, and have seen previous study in concrete complexity (see e.g. [HNW93]). 

Improved lower bound on the FEI constant. Iterated disjoint composition is commonly used 
to achieve separations between complexity measures for Boolean functions [BdW02], and represents 
a natural approach towards disproving the FEI conjecture. For example, one may seek a function 
F such that iterated compositions of F with itself achieves a super-constant amplification of the 
ratio between H[F] and Inf[F], or consider variants such as iterating F with a different combining 
function G. Theorem 3 rules out as potential counterexamples all such constructions based on 
iterated composition. 

However, the tools we develop to prove Theorem 3 also yield an explicit function / achieving 
the best-known separation between H[/] and Inf[/] (i.e. the constant C in the statement of the 
FEI conjecture). In Section 5 we prove: 

Theorem 4. There exists an explicit family of functions fn '■ { — 1, 1}" -^ {~li 1} such that 

lim i^ > 6.278. 

n^oo Int [fn\ 

This improves on the previous lower bound of C > 60/13 ~ 4.615 [OWZll]. 

Previous w^ork. The first published progress on the FEI conjecture was by Klivans et al. who 
proved the conjecture for random poly(n)-term DNF formulas [KLWIO]. This was followed by 
the work of O'Donnell et al. who proved the conjecture for the class of symmetric functions and 
read-once decision trees [OWZll]. 

The FEI conjecture for product distributions was studied in the recent work of Keller et al. 
[KMS12], where they consider the case of all the biases being the same. They introduce the 
following generalization of the FEI conjecture to these measures, and show via a reduction to the 
uniform distribution [BKK~^92] that it is equivalent to the FEI conjecture: 

Conjecture 2 (Keller- Mossel-Schlank). There is a universal constant C such that the following 
holds. Let < p < 1 and f : {—1,1}" — > {—1,1}, where the domain of f is endowed with the product 
distribution where Pr[xi = —1] = p for all z € [n]. Let {f{S)}s(z[n] be the Fourier coefficients of f 
with respect to this distribution. Then 

SC[n] \n^) / ^ 5C[n] 



Notice that in this conjecture, the constant on the right-hand side, C ■ °\"_J' , depends on p. 
By way of contrast, in our Conjecture 1 the right-hand side constant has no dependence on p; 
instead, the dependence on the biases is built into the definition of spectral entropy. We view our 
generalization of the FEI conjecture to arbitrary product distributions (where the biases are not 
necessarily identical) as a key contribution of this work, and point to our composition theorem as 
evidence in favor of Conjecture 1 being a good statement to work with. 

2 Preliminaries 

Notation. We will be concerned with functions / : {—1, 1}!J — s- IR where /U = (/^i, . . . , Hn) € [0, 1]" 
is a sequence of biases. Here the notation {—1, 1}" means that we think of {—1,1}" as being 
endowed with the /i-biased product probability distribution in which E^[xj] = fii for all i £ [n]. We 
write af to denote variance of the z-th coordinate Var^[xj] = 1 — /u?, and c^ : IR — )■ IR as shorthand 
for the function i i— > t^ log(l/i^), adopting the convention that ^^(O) = 0. We will assume familiarity 
with the basics of Fourier analysis with respect to product distributions over {—1, 1}"; a review is 
included in Appendix A. 

Proposition 2.1 (FEI"*" implies FEI). Suppose f satisfies uniform- distribution FEI^ with factor 
C. Then f satisfies the FEI conjecture with factor max{C, l/ln2}. 

Proof. Let /(0)^ = 1 — e, where e = Var[/] by Parseval's identity. By our assumption that / 
satisfies uniform-distribution FEI"'" with factor C, we have 

Y^ f{Sf log i^y^] < C-(Inf[/]-Var[/]) + (l-e)log. ^ 



SC[n] 



f{SY J - ' (l-e) 

< C-(Inf[/]-Var[/]) + ^ 

= C-Inf[/] + (ji^-c)-Var[/]. 

If C > 1/ In 2 then the RHS is at most C ■ Inf [/] since (j^ — C) ■ Var[/] is negative. Otherwise we 
apply the Poincare inequality (Theorem 9) to conclude that the RHS is at most C ■ Inf [/] + (^^^2 ~ 
C).Inf[/] = ^i2-Inf[/]. □ 

3 Composition theorem for FEI+ 

We will be concerned with compositions of functions / = F{gi{x^), . . . , gk{x )) where gi, . . . , (7^ are 
over disjoint sets of variables each of size L The domain of each gi is endowed with a product distri- 
bution //* = {^\, . . . , /x^), which induces an overall product distribution ji = {/i}, . . . , /i^, . . . , /x^, . . . , /i^) 
over the domain of / : {—1, 1} — >■ {—1, 1}. For notational clarity we will adopt the equivalent 
view of 5i, • • • ,5fc as functions over the same domain {—1, 1}^^ endowed with the same product 
distribution /i, with each gi depending only on H. out of ki. variables. 

Our first lemma gives formulas for the spectral entropy and total influence of the product of 
functions $1, . . . , $fc over disjoint sets of variables. The lemma holds for real-valued functions <I>j; 
we require this level of generality as we will not be applying the lemma directly to the Boolean- 
valued functions 51, . . . , 5^ in the composition F{gi{x^), . . . , gk{x^))^ but instead to their normalized 
variants ^{gi) = {gi - ^[gi])/\siY[gif''^ . 



Lemma 3.1. Let $i, . . . , ^^ : {—1, 1}^^ — )• IR where each $j depends only on the i coordinates in 
{{i-l)e+l,...,ii}. Then 

k k 

H^[<I>1 • • • <l>fe] =Y,'i^nH\{n^]\ and InP[<I>i • • • <&,,] = J^ InP [<!>,] J] E[c|>2]. 

Due to space considerations we defer the proof of Lemma 3.1 to Appendix B. We note that this 
lemma recovers as a special case the folklore observation that the FEI conjecture "tensorizes" : for 
any / if we define f®^{x^,. . . ,x^) = /(x^) • • • f{x^) thenH[/®'^] = A;-H[/] andlnf[/®'^] = /c-Inf[/]. 
Therefore H[/] < C ■ Inf [/] if and only if H[/®'^] < C ■ Inf[/®'=]. 

Our next proposition relates the basic analytic measures - spectral entropy, total influence, 
and variance - of a composition / = F[gi[x^), . . . ,gk{x)) to the corresponding quantities of the 
combining function F and base functions gi, . . . ,gi;. As alluded to above, we accomplish this by 
considering / as a linear combination of the normalized functions ^{gi) = {gi — E[(7j])/ Var[(7j]^'^ 
and applying Lemma 3.1 to each term in the sum. We mention that this proposition is also the 
crux of our new lower bound of C > 6.278 on the constant of the FEI conjecture, which we present 
in Section 5. 

Proposition 3.2. Let F : {—1,1}'^ — )• R, and 51,..., ^^ : {—1,1}^^ — > {—1,1} where each gi 
depends only on the i coordinates in {{i — l)i + 1, . . . ,ii}. Let f{x) = F{gi{x), . . . ,gi;{x)) and 
{F{S)}sc[k] be the rj-hiased Fourier coefficients of F where rj = (E^[(7i]), . . . ,E^[(7fc]). Then 

Var^m = j;F(5)2 = Var,[F]. (3) 

57^0 

Proof. By the r/-biased Fourier expansion oi F : {—1,1}^ — )> IR and the definition of rj we have 

5c[n] i^s^l-vf SC[n] ies ^^''^'^9^^ 

so we may write 



F{g,{x),...,g,{x))= ^ F{S)llHg,{x)), where Hg.{x)) = ^'^^ ^^f^ 

SOn] ieS 



Var^[5,]i/2 



Note that <1> normalizes gi such that Ep[<^(5(,)] = and E^[$((7j) ] = 1. First we claim that 



H^'[/-'] = H 



s^Q ies 



^F{S)ll<^{g.) =^U'^\FiS)llHgi) 



S^0 i€S 



It suffices to show that for any two distinct non-empty sets S,T C. [k] , no monomial (p'^ occurs 
in the //-biased spectral support of both F{S) OiGS ^{9i) arid F{T) HieT ^idi)- To see this recall 



that ^(gi) is balanced with respect to /x {i.e. E^[$((7i)] = E^[^{gi)cj}^] = 0), and so every monomial 
(p^ in the support of F{S)Y\^^g^{gi) is of the form HiGS'^c/ '^^ere C/j is a non-empty subset of 
the relevant variables of gi {i.e. {{i — l)i + 1, . . . ,ii})', likewise for monomials in the support of 
F{T)Y\^^rp^{gi). In other words the non-empty subsets of [k] induce a partition of the /u-biased 
Fourier support of /, where (j)^ is mapped to ^ /S C [k] if and only if U contains a relevant 
variable of gi for every z S S" and none of the relevant variables of gj for any j ^ S. 

With this identity in hand we have 

H'^[/>i] 



J2il'[F{S)ll'^{9i 

Si^% i&S 

Y,v{F{S)) + F{SfY.^^^^^g,)]. 



JG5 



^^(F(g))+F(g)^^( ^li:^j^-" +^ 






Var^[5fi] 



iG5 ^ ■ ^'^ 



Var^[(?i]i/2 



Var[5fi 



E^(^)'E 



57^0 



ieS 






where the second and third equalities are two applications of Lemma 3.1 (for the second equality 
we view F{S) as a constant function with H'^[i^(S')] = ip{F{S))). By the same reasoning, we also 
have 



Inf^[/] = Y,InP^[F{S)ll<l>{gi{x')) 



Y,F{S)'Y.In{^mg,)] 



ies 



s^9 



JG5 



E?(^)'ES 



s^a 



JG5 



Var^[5ri] 



Here the second equality is by Lemma 3.1, again viewing F{S) as a constant function with 



Inf^[F(5')] = 0, and the third equality uses the fact that Inf''[a/] 
E^[^j]] = Inf'^[(7j]. Finally we see that 



a 



Ini^lf] and In{>'[gi 



Var^m = 5^ Var^ [F{S)llHg,)] = J^ ^(5)^ J] Var^[<I>(5.)] = J] F(5)^ 



where the last quantity is Var^[F]. Here the second equality uses the fact that the functions ^{gi) 
are on disjoint sets of variables (and therefore statistically independent when viewed as random 
variables), and the third equality holds since Var^[$(gj)] = E[<I>(gj)^] — E[$(5(j)]^ = 1. D 

We are now ready to prove our main theorem: 

Theorem 1. Let F : {—1, 1}^ -^ IR, and gi,. . . ,gk : {—1, l}ff -^ {~1) 1} where each g^ depends 
only on the i coordinates in {(z — 1)^+1, . . . ,ii}. Let f{x) = F{gi{x), . . . ,gk{x)) and suppose C > 
satisfies 



>ii 



1. H^bf ] < C ■ (InPbi] - Var^bi]) for all ie[k]. 

2. H'?[F^i] < C7 ■ (Inr'[F] - Var^[F]), where r] = (E^[gi], . 
Then H^[/^i] < C ■ (InP[/] - Var^[/]). 



,E/,[5fc]). 



7 



Proof. By our first assumption each gi satisfies Inf'^[(7j] > ^H^[g-^] +\'ar^[gi], and so combining 
this with equation (2) of Proposition 3.2 we have 

This along with equations (1) and (3) of Proposition 3.2 completes the proof: 



mr-'] = h''[f^^] + 5:f(5)^eSCi 



5^0 ies 



Var^[5rjj 



< C.{Ini^[F]-Varr,[F]) + Y.nSfY.^^ 

< C ■ (Infq/] - Var,[F]) = C ■ (Inf^[/] - Var^[/]). 

Here the first equality is by (1), the first inequality by our second assumption, the second inequality 
by (4), and finally the last identity by (3). D 

4 Distribution-independent bound for FEI+ 

In this section we prove that /z-biased FEI'^ holds for all Boolean functions F : {— l,l}*j — ?• {—1,1} 
with factor C independent of the biases //i,...,/.ffe of /U. When fi = (0, . . . 0) is the uniform 
distribution it is well-known that the FEI conjecture holds with factor C = 0(log k), and a bound of 
C < 2 is trivial since Inf [F] is always an integer multiple of 2~ and H[F] < 1; neither proofs carry 
through to the setting of product distributions. We remark that even verifying the seemingly simple 
claim "there exists a universal constant C such that H^[MAJ3] < C ■ (Inf^[l\/1AJ3] - Var^[MAJ3]) 
for all product distributions /i G [0, 1]^", where MAJ3 the majority function over 3 variables, turns 
out to be technically cumbersome. 

The high-level strategy is to bound each of the 2—1 terms of H^[F-^] separately; due to space 
considerations we defer the proof the main lemma to Appendix B. 

Lemma 4.1. Let F : {-1,1}^ -^ {-1,1}- Let S C [k], S ^ f/i, and suppose F{S) ^ 0. For any 
j £ S we have 

F{Sf log (^^] <^-Y.r[D,.F]. 



F(5)2 / - ln2 /. 



Theorem 2. Let F : {-1, l}f, -^ {-1, 1}. Then 

H/^[^>i] < 2OW . (Inf^[F] - Var^[F]). 
Proof. The claim can be equivalently stated as H^[F-"'^] < 2^ ' X^^L^ 'Va.rfl[D^^^F], since 

n 

5^ Var[Z?^.F] = Y. \S\ ■ F{Sf < 2 ^ (|S| - 1) • F{Sf = 2 • (InP[F] - Var,,[F]). 

j=l |S|>2 |S|>2 

By Lemma 4.1, for every S ^ % that contributes (p{F{S)) to H^[F-^] we have (p{F{S)) < 
2 *■ ■* Var^ [Z? j,M F] , where j is any element of S. Summing over all 2—1 non-empty subsets S 
of [k] completes the proof. D 



4.1 FEI+ for read-once formulas 

Finally, we combine our two main results so far, the composition theorem (Theorem 1) and the 
distribution-independent universal bound (Theorem 2), to prove Conjecture 1 for read-once formu- 
las with arbitrary gates of bounded arity. 

Definition 5. Let B he a set of Boolean functions. We say that a Boolean function / is a formula 
over the basis if / is computable a formula with gates belonging to B. We say that / is a 
read-once formula over B if every variable appears at most once in the formula for /. 

Corollary 4.2. LetC > and B be a set of Boolean functions, and suppose H'^[F] < C-(Inf'^[F] — 
Var^[F]) for all F ^ B and product distributions fi. Let C be the class of read-once formulas over 
the basis B. Then H^[/] < C ■ (Inf^[/] — Var^j[/]) for all f & C and product distributions fi. 

Proof. We proceed by structural induction on the formula computing /. The base case holds since 
the /i-biased Fourier expansion of the dictator xi and anti-dictator — Xj is ±(/ii -|- o"i0]'(x)) and so 
H^[/^'] = f {{!})' logiaf/ mm = aflogiaf/af) = 0. 

For the inductive step, suppose / = F{gi, . . . ,gk), where F G B and gi,...,gk are read- 
once formulas over B over disjoint sets of variables. Let fi be any product distribution over the 
domain of /. By our induction hypothesis we have li^[gf ] < C • (Inf^[g'j] — Var^[(7j]) for all 
i E [k], satisfying the first requirement of Theorem 1. Next, by our assumption on F (^ B, 
we have H''[F-^] < C ■ (Inf [i^] — Var^[i<']) for all product distributions ry, and in particular, 
r] = (E^[(7i], . . . ,E^[(7fc]), satisfying the second requirement of Theorem 1. Therefore, by Theorem 
1 we conclude that H^[/] < C ■ {Inf'lf] - Var^[/]). D 

By Theorem 2, for any set B of Boolean functions with maximum arity k and product distribu- 
tion /i, every F G B satisfies H^[F] < 2*^^^) • (Inf^[F] — Var^[g]). Combining this with Corollary 

4.2 yields the following: 

Theorem 3. Let B be a set of Boolean functions with maximum arity k, and C be the class of 
read-once formulas over the basis B. Then H^[/] < 2^^^' ■ (Inf^[/] — Var^[/]) for all f ^ C and 
product distributions /x. 

5 Lower bound on the constant of the FEI conjecture 

The tools we develop in this paper also yield an explicit function / achieving the best-known ratio 
between H[/] and Inf [/] (i.e. a lower bound on the constant C in the FEI conjecture). We will use 
the following special case of Proposition 3.2 on the behavior of spectral entropy and total influence 
under composition: 

Lemma 5.1 (Amplification lemma). Let F : {—1,1}^ — )• {—1,1} and g : {—1,1}^ -^ {—1,1} be 
balanced Boolean functions. Let /o = g, and for all m > I, define fm = F[f„i-i{x^), . . . , fm-i{x^))- 
Then 

Inf[/™] = Inf b] • Inf [F]-. 

In particular, if F = g we have 

H[/„] H[F] , H[F] H[F] 



Inf[/^] Inf[F] Inf[F](Inf[F] - 1) Inf[F]™+i(Inf[F] - 1) 



Proof. Since the composition of a balanced function with another remains balanced, we have the 
recurrence relations H[/„,] = U[fm-i] ■ Inf[F] + U[F] and H[/^] = H[/^_i] • Inf[F] + H[F] as 
special cases of Proposition 3.2. Solving them yields the claim. D 

Theorem 4. There exists an infinite family of functions fm '■ { — 1) 1}^" -^ {"^i 1} such that 
lim^^ooH[/„]/Inf[/™] > 6.278944. 

Proof. Let 

g = (xi A X2 A X3) V (xi A X2 A X4) V (xi A 2:2 A 2:5 A xq) V (xi A X2 A X3) V (xi A X2 A X4 A X5). 

It can be checked that g is a. balanced function with H[F] > 3.92434 and Inf [i*"] = 1.625. Applying 
Lemma 5.1 with F = g, we get 

ii[fm] 3.92434 3.92434 

mH'L Inf[/„] - 1.625 + 1.625 x 0.625 " '^•^^^9^^- 

D 
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A Biased Fourier Analysis 

Theorem 6 (Fourier expansion). Let j-i = {fii, . . . , fin) be a sequence of biases. The fx-biased 
Fourier expansion o/ / : { — 1, 1}" ^> IR is 



f{x) = Y, fiswsix), 



5Cfnl 



where 



^u^) = n 



ieS 



Xi fli 



and /(5) = E[/(^)0g(a:)] 



S\-^Jh 



and af = Var^[j;j] = 1 — fif. 



The /i-biased spectral support of / is the collection S C 2'"^ of subsets S C [n] such that 
f{S) / 0. We write /-^ to denote '^\s\>kf(.^)4's(^^^ ^^^ projection of / onto its monomials of 
degree at least k. 

Theorem 7 (Parseval's identity). Let f : {-1,1})^ -^ H. Then Esc[n] /(5')^ = E^[/(^)^]- In 
particular, if the range of f is { — 1, 1} then Xlscfnl fi^)'^ — 1- 



11 



Definition 8 (Influence). Let / : {—1, 1}!] — ?• R. The influence of variable i E [n] on / is 
Inf^[/] = Ep[Var^. [/p]], where p is a /i-biased random restriction to the coordinates in [n]\{i}. 
The total influence of /, denoted Inf'*[/], is X^"=i Inff [/]. 

We recall a few basic Fourier formulas. The expectation of / is given by E^[/] = /(0) and 
its variance yar^[/] = Esj^JiS?- For each i G [n], Inff[/] = Zs^^fiS? and so Inf^/] = 
Sscfnl l"^! ■ /("S*)^- We omit the sub- and superscripts when p = (0, ... ,0) is the uniform distribu- 
tion. Comparing the Fourier formulas for variance and total influence yields the Poincare inequality 
for functions / : {-1, 1}J] ^> E,: 

Theorem 9 (Poincare inequality). Let f : {-I, l}^ -^ R. Then InP[/] < Var^[/]. 

Recall that the i-th discrete derivative operator for / : {—1,1}" — t- {—1,1} is defined to be 

Z?.,(x) = i(/(x^-i)-/(x^— 1)), 

and for S C [n] we write D^sf to denote Ojg^D^../. 

Definition 10 (Discrete derivative). The i-th discrete derivative operator Dam with respect to the 
;U-biased product distribution on {—1, 1}" is defined by D^i^f{x) = aiDxJ{x). 

With respect to the /u-biased Fourier expansion of/:{ — 1,1}"^-]R the operator DjjM satisfies 

S3i 

and so for any S C [n] we have f{S) = E[oi(zsD^f^f] = H^^^ aiE^[{D^s f)]. 

B Omitted Proofs 

Lemma 3.1. Let <l>i, . . . , <l>fc : {—1, 1}^^' — )• R where each ^i depends only on the £ coordinates in 
{{i-l)£ + l,...,ie}. Then 

k k 

H'^[$i---<I>fc]= J^H^[cl.i]J];E[cI>|] and InP[$i •••$,,] = ^ InP[$,] J] E[cl.2]. 

Proof. We prove both formulas by induction on k, noting that the bases cases are trivially true. 
For the inductive step, we define h{x) = riieffc-il *^«(^) and see that 

sc[(fc-i)f] xn-w) '^k[^ ) / 

Tc{{k-i)e+i,...ke} 



Y,HSf<^kiT)' 

S,T 



log a^Uiog a^ 






fc-1 



k 



5^ H'^ [<!>,] nE[$ 



3+^ 
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Here in the first equality we use the fact that if/:{ — 1,1}"— J-R does not depend on coordinate 
i G [n] then f{S) = for all S 3 i {i.e. the Fourier spectrum of / is supported on sets containing 
only its relevant variables). The third equality is by Parseval's, and the fourth by the induction 
hypothesis applied to h. 

The formula for influence follows from a similar derivation: 

InP[/i-^fc] = Yl \SUT\-h{Sf¥k{Tf 

sc[{k-i)e] 
Tc{{k-i)e+i,...ke} 

= Y.\T\- h{SfWk{Tf + Y.\^\- KSf^k{Tf 

S,T S,T 

= E[/i2] • Inf'^[$fc] + E[$|] • Ini''[h] 



k~l 



n mh-inn^k]+n'^i] j^inf^i^^dllEi^, 



iG[fe-l] 



1=1 



j¥« 



i=l 



JT^i 



and this completes the proof. 



D 



Lemma 4.1. Let F : {-1, 1}^ -^ {-1, 1}. Let S C [k], S ^ $, and suppose F{S) ^ 0. For any 
j G S we have 



F(S)2 / - ln2 /. ^ ^J J 



Proof. Recah that F{S) = Ef,[oi(,sD^,^f] = UieS '^i^i^i^xsf], and so 



F{Sf log (ih^^^ 



ieS 






Here the first inequality holds since t^log(l/t^) < t/ln(2) for all t € R"'^, and the second uses the 
fact that D^sF is bounded within [—1,1]. Therefore it suffices to argue that 

llafl>r[D,sF^O] < 22^= • Var[D^MF] 



ies 



2^^ a] ■ \siv[DjF] 



'' T' ' 



o2fc 2 

2 a J 



E 

J/G{-1,1}'"1\£ 



E [{{DjF)\y{z)-fif] 
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where // = 'E[DjF] and {DjF)\y denotes the restriction of DjF where the coordinates in [n]\S' are 
set according to y. We first rewrite the desired inequality above as 



2 2fc Yl 

ieS\{j} 



^' ' ,.{-U}N\s[^^.-^(^)^°] 



< E 

J/G{-1,1}["1\'5 



E [{iDjF)\y{z) - fif] 



and argue that this holds point-wise: for every y G [n]\S such that D^sF{y) ^ 0, 

^[{{D,F)\y{z)-nf]>2-'^ n ^^ 

ies\{j} 

To see this, fix y e {-1,1}W\5 such that {D^sF){y) / 0. Viewing {D^sF) as {D^s\{j}DjF), it 
follows that {DjF)\y is non-constant. Since {DjF)\y takes values in {—1,0,1}, there must exist 
some z* e {-1, l}'^\'f-5''} such that \{DjF)\y{z*) - fJ,\ > ^ and so indeed 



E[{{DjF)\,{z)-i,'f] > Q) Prlz = z 

- J n '^''■ 



in 



crt 



> _ II ^ > 2~2fc TT 

4 J.X 2 - 4 J-J- 4 - J-J- 

iG5\{j} i6S\{j} ieS\{j} 



al 
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